Bayesian Sparse Partial Least Squares
نویسندگان
چکیده
Partial least squares (PLS) is a class of methods that makes use of a set of latent or unobserved variables to model the relation between (typically) two sets of input and output variables, respectively. Several flavors, depending on how the latent variables or components are computed, have been developed over the last years. In this letter, we propose a Bayesian formulation of PLS along with some extensions. In a nutshell, we provide sparsity at the input space level and an automatic estimation of the optimal number of latent components. We follow the variational approach to infer the parameter distributions. We have successfully tested the proposed methods on a synthetic data benchmark and on electrocorticogram data associated with several motor outputs in monkeys.
منابع مشابه
Sparse partial least squares regression for simultaneous dimension reduction and variable selection
Partial least squares regression has been an alternative to ordinary least squares for handling multicollinearity in several areas of scientific research since the 1960s. It has recently gained much attention in the analysis of high dimensional genomic data. We show that known asymptotic consistency of the partial least squares estimator for a univariate response does not hold with the very lar...
متن کاملPoster Abstract: Sparse Bayesian Distributed Least-Squares Strategies for Adaptive Networks
In this work we present a sparse distributed recursive least-squares (dRLS) algorithm for adaptive sensor networks. The algorithm allows to prune weights by exploiting sparse Bayesian learning, while at the same time adding automatic regularization to improve numerical stability. With this reduction of computational complexity, the amount of energy consumption and data to be transmitted between...
متن کاملUnderdetermined Wideband DOA Estimation for Off-Grid Sources with Coprime Array Using Sparse Bayesian Learning
Sparse Bayesian learning (SBL) is applied to the coprime array for underdetermined wideband direction of arrival (DOA) estimation. Using the augmented covariance matrix, the coprime array can achieve a higher number of degrees of freedom (DOFs) to resolve more sources than the number of physical sensors. The sparse-based DOA estimation can deteriorate the detection and estimation performance be...
متن کاملMapping Sparse Representation to State Likelihoods in Noise-Robust Automatic Speech Recognition
This paper proposes learning-based methods for mapping a sparse representation of noisy speech to state likelihoods in an automatic speech recognition system. We represent speech as a sparse linear combination of exemplars extracted from training data. The weights of exemplars are mapped to speech state likelihoods using Ordinary Least Squares (OLS) and Partial Least Squares (PLS) regression. R...
متن کاملSparse Orthonormalized Partial Least Squares
Orthonormalized partial least squares (OPLS) is often used to find a low-rank mapping between inputs X and outputs Y by estimating loading matrices A and B. In this paper, we introduce sparse orthonormalized PLS as an extension of conventional PLS that finds sparse estimates of A through the use of the elastic net algorithm. We apply sparse OPLS to the reconstruction of presented images from BO...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Neural computation
دوره 25 12 شماره
صفحات -
تاریخ انتشار 2013